Methods and systems for operating a moving platform to determine data associated with a target person or object

ABSTRACT

Methods and systems for operating a moving platform to determine an identity of an unidentified target are disclosed. In an example method to determine the identity of the unidentified target, a first moving platform, configured with a first type of sensor, is caused to move to an area associated with the target. An attempt is made to determine, via the first moving platform and the first type of sensor, the identity of the target. Based on the attempt, a second moving platform, configured with a second type of sensor, is caused to move to the area. The identity of the target is determined via the second moving platform and the second type of sensor.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. application Ser.No. 16/385,406, filed Apr. 16, 2019, entitled “Methods and Systems forOperating a Moving Platform to Determine Data Associated with a TargetPerson or Object,” which is incorporated by referenced herein in itsentirety.

FIELD

This application generally relates to operating a moving platform, inparticular operating a moving platform to determine data associated witha target person or object.

BACKGROUND

A moving platform, as used herein, is an aircraft that operates withoutan on-board human operator. Indeed, a moving platform may be configuredfor relatively autonomous operation and flight. As such, movingplatforms may be used for various sorts of information gathering, aerialphotography or videography, surveillance, surveying, and even cargotransport. To accomplish such objective(s), a moving platform may beconfigured with a variety of sensors. Yet a given moving platform may belimited in the types of sensors that the moving platform may bear. Forexample, a moving platform may be configured with only a small number ofsensors—and of limited types—due to weight considerations. The costassociated with an expansive sensor configuration and the larger movingplatform needed to bear such sensor configuration may also be a limitingfactor. Thus, a typical moving platform is likely unable to perform itsrole, particularly those relating to information gathering, photographyor videography, surveillance, surveying, or the like, across allpossible scenarios and operating conditions.

Thus, what is desired in the art is a technique and architecture fordetermining, using one or more moving platforms, at least one of anobject associated with a target or an activity associated with thetarget.

What is also desired in the art is a technique and architecture fordetermining, using one or mote moving platforms, an identity of anunidentified target.

What is still further desired in the art is a technique and architecturefor determining, using one or more moving platforms, a location of aknown target.

SUMMARY

The foregoing needs are met, to a great extent, by the disclosedsystems, methods, and techniques for operating a moving platform todetermine data associated with a target person or object.

One aspect of the patent application is directed to determining at leastone of an object associated with a target or an activity associated withthe target. The target may be a target person. An example methodincludes receiving an instruction to determine the at least one of anobject associated with the target or an activity associated with thetarget. A first moving platform is caused to move to an area associatedwith the target. The first moving platform is configured with a firsttype of sensor. The target is located, via the first moving platform, atthe area. An attempt is made to determine, via the first moving platformand the first type of sensor, the at least one of an object associatedwith the target or an activity associated with the target. Based on theattempt to determine the at least one of an object associated with thetarget or an activity associated with the target, a second movingplatform is caused to move to the area. The second moving platform isconfigured with a second type of sensor that is different from the firsttype of sensor of the first moving platform. The at least one of anobject associated with the target or an activity associated with thetarget is determined via the second moving platform and the second typeof sensor.

Another aspect of the patent application is directed to determining anidentity of an unidentified target at a first area. The target may be atarget person or a target inanimate object. An example method includesreceiving an instruction to determine the identity of the unidentifiedtarget at the first area associated with the target. A first movingplatform is caused to move to the first area. The first moving platformis configured with a first type of sensor. An attempt is made todetermine, via the first moving platform and the first type of sensor,the identity of the target. Based on the attempt to determine theidentity of the target, a second moving platform is caused to move tothe first area. The second moving platform is configured with a secondtype of sensor that is different from the first type of sensor of thefirst moving platform. The identity of the target is determined via thesecond moving platform and the second type of sensor.

Yet another aspect of the patent application is directed to locating aknown target at an area associated with the target. The target may be atarget person, a target animal, or a target inanimate object. An examplemethod includes receiving an instruction to locate the known target atthe area associated with the target. A first moving platform is causedto move to the area. The first moving platform is configured with afirst type of sensor. An attempt is made to locate, via the first movingplatform and the first type of sensor, the target at the area. Based onthe attempt to locate the target, a second moving platform is caused tomove to the area. The second moving platform is configured with a secondtype of sensor that is different from the first type of sensor of thefirst moving platform. The target is located via the second movingplatform and the second type of sensor.

There has thus been outlined, rather broadly, certain embodiments of theapplication in order that the detailed description thereof herein may bebetter understood, and in order that the present contribution to the artmay be better appreciated. There are, of course, additional embodimentsof the application that will be described below and which will form thesubject matter of the claims appended hereto.

BRIEF DESCRIPTION OF THE DRAWINGS

To facilitate a fuller understanding of the application, reference ismade to the accompanying drawings, in which like elements are referencedwith like numerals. These drawings should not be construed to limit theapplication and are intended only for illustrative purposes.

FIG. 1A illustrates a diagram of an example system according to anaspect of the application.

FIG. 1B illustrates a block diagram of an example moving platformaccording to an aspect of the application.

FIG. 1C illustrates a block diagram of an example computing systemaccording to an aspect of the application.

FIG. 2 illustrates a diagram of an example operation, according to anaspect of the application, within the system of FIG. 1A.

FIG. 3 illustrates an example graphical user interface according to anaspect of the application.

FIG. 4 illustrates a method flowchart according to an aspect of theapplication.

FIG. 5 illustrates a method flowchart according to an aspect of theapplication.

FIG. 6 illustrates a method flowchart according to an aspect of theapplication.

DETAILED DESCRIPTION

Before explaining at least one embodiment of the application in detail,it is to be understood that the application is not limited in itsapplication to the details of construction and to the arrangements ofthe components set forth in the following description or illustrated inthe drawings. The application is capable of embodiments in addition tothose described and of being practiced and carried out in various ways.Also, it is to be understood that the phraseology and terminologyemployed herein, as well as the abstract, are for the purpose ofdescription and should not be regarded as limiting.

Reference in this application to “one embodiment,” “an embodiment,” “oneor more embodiments,” or the like means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the disclosure. Theappearances of, for example, the phrases “an embodiment” in variousplaces in the specification are not necessarily all referring to thesame embodiment, nor are separate or alternative embodiments mutuallyexclusive of other embodiments. Moreover, various features are describedwhich may be exhibited by some embodiments and not by the other.Similarly, various requirements are described which may be requirementsfor some embodiments but not for other embodiments.

FIG. 1A is a diagram of an example system 10 in which one or moredisclosed embodiments may be implemented. In the system 10, one or moremoving platforms 18 are in mutual communication, via a communicationnetwork 12, with a central system 14. A wireless base station 16 mayeffectuate wireless communication with one or more moving platforms 18while such moving platforms 18 are in flight. For example, a movingplatform 18 may be deployed to track and gather information regarding atarget person or object and report such information back to the centralsystem 14 via the wireless base station 16 for processing by the centralsystem 14. Further, while a moving platform 18 is deployed to track atarget person or object, the moving platform 18 may communicate via thewireless base station 16 to indicate that another moving platform 18 bedeployed to replace the initial moving platform 18 and/or to augment theinitial moving platform 18 with additional sensor capabilities. In someinstances, a moving platform 18 may relay a message to the wireless basestation 16 from another moving platform 18 that is not within range ofthe wireless base station 16. A moving platform 18 may furthercommunicate with the central system 14 via a wired connection to anintermediate system 20. For instance, a moving platform 18 may bedeployed from and communicate with a deployment station 22 of theintermediate system 20. The central system 14 may generally directoperations within the system 10, such as providing instructions to oneor more moving platforms 18 to effectuate a mission or task.

A moving platform 18 may generally refer to a device configured forflight and comprising one or more sensors to capture information (e.g.,images or video) regarding a target and/or various environmentalvariables (e.g., wind speed or light level). A moving platform 18 may beconfigured for generally autonomous operation once provided instructionsrelating to a mission. For example, a moving platform 18 may capturedata and determine further actions based on the captured data. Forinstance, a moving platform 18 may determine that its visible spectrumcamera is insufficient for a mission and transmit a request that asecond moving platform 18 be deployed that is configured with aninfrared camera. In other instances, a moving platform 18 may transmitdata back to the central system 14 for processing. The moving platform18 may await instructions from the central system 14.

A moving platform 18 may comprise an unmanned aerial vehicle (UAV), suchas a drone. A moving platform 18 may be configured as a rotary platform,such as a multirotor drone (e.g., a tricopter, quadcopter, hexacopter,or an octocopter). A rotary design may be appropriate for use when agenerally static hovering position facilities image or video capture,for example. Alternatively, a moving platform 18 may be configured as afixed wing platform, such as a miniaturized airplane design or the like.Use of a fixed wing design may be appropriate, for example, when weatherconditions inhibit flight and control of a rotary design. For example, afixed wing design may exhibit better performance during high winds orrain than a rotary design. A moving platform 18 may be also configuredas a combination fixed wing/rotary design or a design that can convertbetween fixed wing and rotary modes.

As will be discussed further in regards to FIG. 1B, a moving platform 18may be configured with one or more communication interfaces, such as aradio transceiver and/or a wired communication interface. Thecommunication interface(s) of a moving platform 18 may be used forwireless communication with the wireless base station 16. A wirelesscommunication interface of a moving platform 18 may be further used forwireless communication between moving platforms 18. Additionally oralternatively, the communication interface(s) of a moving platform 18may be used for wired communication with the intermediate system 20,including the deployment station 22.

The wireless base station 16 may comprise one or more components and/ornetwork elements that effectuate wireless communication with a movingplatform 18. The wireless base station 16 may comprise abase transceiverstation (BTS). The wireless base station 16 may be considered as agateway in some implementations. Such wireless communication maygenerally comprise radio-frequency (RF) communication but is not solimited. As an example, the wireless base station 16 may comprise acellular base station to effectuate communication with one or moremoving platforms 18 via a cellular network. As another example, thewireless base station 16 may comprise a wireless access point to acomputer network, such as a wireless location area network (WLAN) (e.g.,a Wi-Fi network) or a wireless wide area network (WAN). In someinstances, a moving platform 18 may not always be within communicationrange of a wireless base station 16. For example, the area in which atarget is located may be out of communication range of a wireless basestation 16. Thus, a deployed moving platform 18 may need to move backwithin range of a wireless base station 16 to connect with the wirelessbase station 16 for communication with the central system 14.Additionally or alternatively, the deployed moving platform 18 may useanother moving platform 18 as a relay to communicate via the wirelessbase station 16. While FIG. 1A depicts a single wireless base station16, it is envisioned that the system 10 may include two or more wirelessbase stations 16.

The intermediate system 20 may comprise one or more componentsconfigured, including the deployment station 22, to effectuate a wiredconnection with a moving platform 18. The intermediate system 20 maycomprise a server 21 or other computing device, such as to relayinstructions from the central system 14, perform object recognition forcaptured images, or determine that a second moving platform 18 should bedeployed. The intermediate system 20 may be configured with a wiredcommunication interface via which a moving platform 18 may connect tothe intermediate system 20. The wired communication interface maycomprise a USB port, a universal asynchronous receiver-transmitter(UART) port, or a wired ethernet port, for example. Proprietary wired ordirect physical interfaces may also be used.

The deployment station 22 may be implemented as a docking station orbase for a moving platform 18. The deployment station 22 may provide adeployment and landing platform for a moving platform 18, as well ascharge the battery of the moving platform 18. In use, a deployed movingplatform 18 may capture information associated with a target (e.g.,images, video, or sound recordings) and/or the target's surroundings andreturn to the intermediate system 20. There, a wired connection may beestablished between the moving platform 18 and the deployment station 22for the captured information to be uploaded to the central system 14 viathe intermediate system 20. Further instructions from the central system14 may be also provided to the moving platform 18 via the wiredconnection with the deployment station 22.

The central system 14 may generally direct or control operations of thesystem 10. For example, instructions may be initially entered (e.g., bya human operator) to the central system 14 for a particular target to betracked and observed. Mission instructions, including various missionparameters, may be entered via a graphical user interlace (GUI) providedby the central system 14. The central system 14 may then provideinstructions to a moving platform 18 to effectuate the tracking andobservation. The central system 14 may additionally or alternativelydetermine if and when additional moving platforms 18 should be deployedto supplement or replace a currently deployed moving platform 18. Thecentral system 14 may receive data captured by a deployed movingplatform 18, as well as process and store such data. This may includelocations of a moving platform 18 and corresponding timestamps.Additionally or alternatively, moving platform 18 locations andcorresponding timestamps may be received by the central system 14 froman external source, such as a GPS system tracking the locations of amoving platform 18.

Such controls, among others, may be effectuated via the GUI provided bythe central system 14. For example, an operator may interact with theGUI to cause a moving platform 18 to be deployed to fulfill a mission orto replace or support an already deployed moving platform 18. As anotherexample, an operator may interact with the GUI to request data (e.g.,captured data) from a moving platform 18. As yet another example, anoperator may interact with the GUI to cause the central system 14 totransmit data to a moving platform 18, such as the results of objectrecognition performed by the central system 14.

The central system 14 may perform object recognition and analysis onimages or video captured by a moving platform 18. For example, thecentral system 14 may perform facial recognition on an image todetermine if a person in the image is the target person that the missionseeks to identify. The central system 14 may employ a machine-learnedobject recognition algorithm to determine the identities of any personsdepicted in an image or video. The machine-learned object recognitionalgorithm may also be applied to identify inanimate objects in capturedimages or video.

The communication network 12 may be a fixed network (e.g., Ethernet,Fiber, ISDN, PLC, or the like) or a wireless network (e.g., WLAN,cellular, or the like) or a network of heterogeneous networks. Forexample, the communication network 12 may be comprised of multipleaccess networks that provide communications, such as voice, data, video,messaging, broadcast, or the like. For example, the communicationnetwork 12 may employ one or more channel access methods, such as codedivision multiple access (CDMA), time division multiple access (TDMA),frequency division multiple access (FDMA), orthogonal FDMA (OFDMA),single-carrier FDMA (SC-FDMA), and the like. Further, the communicationnetwork 12 may comprise other networks such as a core network, theInternet, a sensor network, an industrial control network, a personalarea network, a fused personal network, a satellite network, a homenetwork, or an enterprise network, as some examples. The wireless basestation 16 and/or the intermediate system 20 may be considered as partof the communication network 12 in some embodiments.

FIG. 1B is a block diagram of an exemplary hardware/softwarearchitecture of a moving platform 30 (e.g., a moving platform 18 of FIG.1A). As shown in FIG. 1B, the moving platform 30 may include one or moreprocessors 32, a communication interface 40, one or more sensors 42,non-removable memory 44, removable memory 46, a power source 48, aglobal positioning system (GPS) chipset 50, and other peripherals 52.The moving platform 30 may also include communication circuitry, such asone or more transceivers 34 and a transmit/receive element 36. It willbe appreciated that the moving platform 30 may include anysub-combination of the foregoing elements while remaining consistentwith an embodiment.

The processor 32 may be a general purpose processor, a special purposeprocessor, a conventional processor, a digital signal processor (DSP), aplurality of microprocessors, one or more microprocessors in associationwith a DSP core, a controller, a microcontroller, Application SpecificIntegrated Circuits (ASICs), Field Programmable Gate Array (FPGAs)circuits, any other type of integrated circuit (IC), a state machine,and the like. In general, the processor 32 may executecomputer-executable instructions stored in the memory (e.g., the memory44 and/or the memory 46) of the moving platform 30 in order to performthe various required functions of the moving platform 30. For example,the processor 32 may perform signal coding, data processing, powercontrol, input/output processing, sensor control, flight control, and/orany other functionality that enables the moving platform 30 to operatein a directed mission. The processor 32 may run radio access-layer (RAN)programs and/or other communications programs. The processor 32 may alsoperform security operations such as authentication, security keyagreement, and/or cryptographic operations, such as at the access-layerand/or application layer for example.

The processor 32 is coupled to its communication circuitry (e.g., thetransceiver 34, the transmit/receive element 36, and the communicationinterface 40). The processor 32, through the execution of computerexecutable instructions, may control the communication circuitry inorder to cause the moving platform 30 to communicate with othercomponents of the system, such as other moving platforms, anintermediate system (e.g., the intermediate system 20 of FIG. 1A, viawired connection), or a wireless base station (e.g., the wireless basestation 16 of FIG. 1A). In particular, the processor 32 may control thecommunication circuitry in to effectuate the techniques describedherein, including locating a target person or object, tracking saidtarget, and/or capturing data relating to said target. While FIG. 1Bdepicts the processor 32 and the transceiver 34 as separate components,it will be appreciated that the processor 32 and the transceiver 34 maybe integrated together in an electronic package or chip.

The transmit/receive element 36 may be configured to transmit signals toor receive signals from other moving platforms or other components orsystems described in relation to FIG. 1A. For example, in an embodiment,the transmit/receive element 36 may be an antenna configured to transmitand/or receive RF signals. The transmit/receive element 36 may supportvarious networks and air interfaces, such as WLAN, WPAN, cellular, andthe like. In an embodiment, the transmit/receive element 36 may be anemitter/detector configured to transmit and/or receive IR, U V, orvisible light signals, for example. In yet another embodiment, thetransmit/receive element 36 may be configured to transmit and receiveboth RF and light signals. It will be appreciated that thetransmit/receive element 36 may be configured to transmit and/or receiveany combination of wireless or wired signals. The transceiver 34 and/ortransmit/receive element 36 may be integrated with, in whole or in part,the communication interface(s) 40, particularly wherein a communicationinterlace 40 comprises a wireless communication interface. Thecommunication interface(s) 40 additionally or alternatively may compriseone or more wired communication interfaces.

The processor 32 may access information from, and store data in, anytype of suitable memory, such as the non-removable memory 44 and/or theremovable memory 46. For example, the processor 32 may store captureddata (e.g., images, videos, environmental data, etc.) in its memory, asdescribed above. The non-removable memory 44 may include random-accessmemory (RAM), read-only memory (ROM), a hard disk, or any other type ofmemory storage device. The removable memory 46 may include a subscriberidentity module (SIM) card, a memory slick, a USB drive, a securedigital (SD) memory card, and the like. In other embodiments, theprocessor 32 may access information from, and store data in, memory thatis not physically located on the moving platform 30, such as on a remotesystem or other moving platform.

The processor 32 may control operation of the one or more sensors 42 ofthe moving platform 30 to capture data relating to an assigned mission.The one or more sensors 42 may comprise imaging sensors, including astill image camera or video camera. A camera may capture images/video inthe visible frequency spectrum, the ultraviolet frequency spectrum, theinfrared frequency spectrum, or any combination thereof. For example, aninfrared camera may capture thermal imaging. A camera may also beconfigured as a night-vision camera. The one or more sensors 42 mayinclude a sound sensor (e.g., a microphone or acoustic camera). Types ofsound sensors may be defined according to sound sensitivity and/orfrequency response. The one or more sensors 42 may further comprisevarious environmental sensors, including a wind sensor, a moisture/rainsensor, and a light level sensor. The one or more sensors 42 may alsoinclude one or more RF transceivers, such as to capture an RF signal orsignature. Different moving platforms may be configured with differentsensor profiles. For example, one moving platform may be configured witha high-resolution, visible light spectrum camera best suited for day usewhile a second moving platform may be configured with infrared andnight-vision cameras suitable for night use. The processor 32 mayadditionally analyze data captured by the sensor(s) 42 and/or cause themoving platform 30 to transmit at least a portion of the captured datato a central system for analysis there.

The processor 32 may receive power from the power source 48, and may beconfigured to distribute and/or control the power to the othercomponents in the moving platform 30. The power source 48 may be anysuitable device for powering the moving platform 30. For example, thepower source 48 may include one or more dry cell batteries (e.g.,nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel metal hydride (NiMH),lithium-ion (Li-ion), etc.), solar cells, fuel cells, and the like. Theprocessor 32 may monitor the power level of the power source 48. Thepower level may be one factor that affects whether one or more othermoving platforms are deployed to replace or assist the moving platform30 in tracking a target or other aspect of the mission.

The processor 32 may also be coupled to the GPS chipset 50, which isconfigured to provide location information (e.g., longitude and latitudecoordinates, as well as altitude) regarding the current location of themoving platform 30. It will be appreciated that the moving platform 30may acquire location information by way of any suitablelocation-determination technique while remaining consistent with anembodiment. For example, the moving platform 30 may be connected toseveral wireless base stations and a triangulation technique may be usedto determine the location of the moving platform 30.

FIG. 1C is a block diagram of an exemplary computing system 90 which maybe used to implement components of the system, including an intermediatesystem (e.g., the intermediate system 20 and/or deployment station 22 ofFIG. 1A) for wired communication, a wireless base station (e.g., thewireless base station 16), or a central system (e.g., the central system14). Aspects of the computing system 90 may be also used to implement amoving platform (e.g., a moving platform 18 of FIG. 1A or the movingplatform 30 of FIG. 1B).

The computing system 90 may comprise a computer or server and may becontrolled primarily by computer readable instructions, which may be inthe form of software, wherever, or by whatever means such software isstored or accessed. Such computer readable instructions may be executedwithin a processor, such as a central processing unit (CPU) 91, to causethe computing system 90 to do work. In many known workstations, servers,and personal computers, the central processing unit 91 is implemented bya single-chip CPU called a microprocessor. In other machines, thecentral processing unit 91 may comprise multiple processors. Acoprocessor 81 is an optional processor, distinct from the main CPU 91that performs additional functions or assists the CPU 91. The CPU 91and/or the coprocessor 81 may receive data captured by a moving platformand process such data to facilitate tracking a target or other objectiveof a mission.

In operation, the CPU 91 fetches, decodes, executes instructions, andtransfers information to and from other resources via the computer'smain data-transfer path, system bus 80. Such a system bus connects thecomponents in the computing system 90 and defines the medium for dataexchange. The system bus 80 typically includes data lines for sendingdata, address lines for sending addresses, and control lines for sendinginterrupts and for operating the system bus 80. An example of such asystem bus 80 may be the PCI (Peripheral Component Interconnect) bus orPCI Express (PCIe) bus.

Memories coupled to the system bus 80 include random access memory (RAM)82 and read only memory (ROM) 93. Such memories include circuitry thatallows information to be stored and retrieved. The ROMs 93 generallycontain stored data that cannot easily be modified. Data stored in theRAM 82 may be read or changed by the CPU 91 or other hardware devices.Access to the RAM 82 and/or the ROM 93 may be controlled by thecontroller 92. The memory controller 92 may provide an addresstranslation function that translates virtual addresses into physicaladdresses as instructions are executed. The memory controller 92 mayalso provide a memory protection function that isolates processes withinthe system and isolates system processes from user processes. Thus, aprogram running in a first mode may access only memory mapped by its ownprocess virtual address space; it cannot access memory within anotherprocess's virtual address space unless memory sharing between theprocesses has been set up.

In addition, the computing system 90 may comprise a peripheralscontroller 83 responsible for communicating instructions from die CPU 91to peripherals, such as a printer 94, a keyboard 84, a mouse 95, and adisk drive 85. A display 86, which is controlled by a display controller96, is used to display visual output generated by the computing system90. Such visual output may include text, graphics, animated graphics,and video. Visual output may farther comprise a GUI, such as the GUI 300in FIG. 3, configured to effectuate various operations of the system 10.The display 86 may be implemented with a CRT-based video display, anLCD-based flat-panel display, gas plasma-based flat-panel display, or atouch-panel. The display controller 96 includes electronic componentsrequired to generate a video signal that is sent to the display 86.

Further, the computing system 90 may comprise communication circuitry,such as a network adaptor 97, that may be used to connect the computingsystem 90 to an external communications network, such as thecommunication network 12 of FIGS. 1A-C, to enable the computing system90 to communicate with other components of the system and network.

FIG. 2 illustrates an example operation within the system 10 accordingto at least some aspects of the disclosure. Initially, a first movingplatform 18 a is deployed to a first area 200 associated with a target(e.g., a target person 202). The first moving platform 18 a may bedeployed based on one or more instructions. The instructions may taskthe first moving platform 18 a to locate the target person 202,determine the identity of the target person 202, determine objects(e.g., person 204 a and/or person 204 b) and/or activities associatedwith the target person 202, provide cellular service to the targetperson 202, or any combination thereof. Although not depicted in FIG. 2,the first moving platform 18 a may have been deployed from thedeployment station 22. In some aspects, the target person 202 may beinstead a target inanimate object, such as a vehicle or lost pet.Additionally or alternatively, in some aspects, the one or more of thepersons 204 a, 204 b may be instead an inanimate object, such as avehicle or drug package.

The first moving platform 18 a, at the first area 200, may attempt toperform the task(s) indicated in the instructions. The first movingplatform 18 a may attempt to perform the tasks using one or more sensorsof the first moving platform 18 a, such as a visible light camera. Thefirst moving platform 18 a, however, may be unable to perform thetask(s) using its equipped sensors, such as being unable to captureadequate images of the target person 202 or associated persons 204 a,204 b. Additionally or alternatively, environmental variables at thefirst area 200, such as high wind speed, may hinder or prevent the firstmoving platform 18 a from completing its tasks. Additionally oralternatively, the first moving platform 18 a may have low batterypower. The first moving platform 18 a may wirelessly communicate, viathe wireless base station 16, the status of its attempts to perform theassigned task(s) to the central system 14. The first moving platform 18a may further communicate, via the wireless base station 16, captureddata (e.g., captured images) to the central system 14 for processing.The first moving platform 18 a may yet further communicate its locationand a current time to the central system 14.

Due to an inability or inadequacy of the first moving platform 18 a tocomplete its assigned tasks, a second moving platform 18 b is deployed(indicated by dotted arrow) from the deployment station 22 to the firstarea 200 to replace or supplement the first moving platform 18 a at thefirst area 200. Deployment of the second moving platform 18 b may bedetermined by the intermediate system 20 or the central system 14. Thesecond moving platform 18 b may have a different configuration than thefirst moving platform 18 a, such as with respect to sensors, flightcapabilities, communication capabilities, or battery power. For example,the second moving platform 18 b may be configured with a night-visioncamera to compensate for the inadequate visible light daytime camera ofthe first moving platform 18 a.

The first moving platform 18 a may communicate wirelessly with thesecond moving platform 18 b upon the second moving platform's 18 barrival at the first area 200. For example, the first moving platform 18a may communicate its status in performing the assigned tasks, as wellas any data captured by the first moving platform 18 a. For example, thefirst moving platform 18 a may communicate to the second moving platform18 b the first moving platform's 18 a battery power level, the remainingflight time of the first moving platform 18 a given said battery powerlevel, any preliminary estimated locations of the target person 202, anypreliminary estimated identities of the target person 202, anypreliminary estimated identities of the associated persons 204 a, 204 b,the sensor profile of the first moving platform 18 a, the location ofthe first moving platform 18 a, and/or any environmental variables atthe first area 200. The first moving platform 18 a may remain at thefirst area 200 or may return to the deployment station 22, such as toupload captured data via a wired connection with the deployment station22.

At the first area 200, the second moving platform 18 b may therebyperform, at least in part, the tasks indicated in the initialinstructions. For example, the second moving platform 18 b may capturenight-vision images of the target person 202 or persons 204 a, 204 bassociated with the target person 202. Such captured data may betransmitted, such as via the wireless base station 16, to the centralsystem 14 for processing. Additionally or alternatively, the secondmoving platform 18 b may return to the deployment station 22 and uploadthe captured data via the wired connection with the deployment station22. The data captured by the second moving platform 18 b may be used tocomplete the assigned task, such as locating the target person 202,determining an object and/or activity associated with the target person202, determining the identity of the target person 202, and/or providingcellular service to the target person 202. Machine learning algorithmsmay be used to facilitate various aspects of these techniques, includingobject recognition, target locating, target tracking, and RFcommunication. Such machine learning algorithms may include aconvolutional neural network (CNN) or other types of neural networks.

FIG. 3 illustrates an example graphical user interface (GUI) 300 thatmay be used in conjunction with techniques disclosed herein. The GUI 300may be generally used to initiate and/or direct various operations ofthe system 10 of FIG. 1A. For example, the GUI 300 may be used to directa moving platform (e.g., the moving platform(s) 18 of FIGS. 1A and 2) toan area to effectuate a mission, such as locating a missing person. Asanother example, the GUI 300 may be used to receive updates on thestatus of the mission, as well as cause data exchanges between adeployed moving platform and a control system, such as a central system.As another example, the GUI 300 may be used to deploy a second movingplatform to the area if the initial moving platform is unsuccessful inaccomplishing its mission or requires support from the second movingplatform. The GUI 300 may be implemented at a central system (e.g., thecentral system 14 of FIG. 1A). The GUI 300 may be used by operators atthe central system or the GUI 300 may be accessed by operators remotely,such as via a webpage.

The GUI 300 comprises a display area 310, a mission status area 330, anda plurality of interactive interface elements 312-324. Activation of anyof the interface elements 312-324 may cause a pop-up window to bedisplayed, via which various parameters relating to that interfaceelement may be entered by an operator.

The display area 310 may be configured to display various data capturedby one or more deployed moving platforms. For example, the display area310 shown in FIG. 3 depicts a bird's eye image or video captured by adeployed moving platform at an area. The image or video in the displayarea 310 depicts various objects at the area, including a person 302.The person 302 may be a target person that a mission seeks to locate oridentify, for example. Object recognition may be performed on the imageor video depicted in the display area 310 to identify or attempt toidentify, for example, the person 302. As object recognition isperformed on the image or video, the object recognition process itselfmay be depicted in the display area 310. The display area 310 may bealso used to show thermal images or acoustic or RF signatures (e.g.,waveforms) captured by a moving platform.

The interface element 320 is configured to, upon activation, enable anoperator to input instructions (e.g., via a further pop-up window) toinitiate a mission involving one or more moving platforms. The interfaceelement 320, upon activation, may further enable an operator to inputvarious parameters relating to said mission, such as the type ofmission, a target of the mission, and an area associated with thetarget.

The interface element 314 is configured to, upon activation, cause amoving platform to be deployed, such as from a deployment station. Theinterface element 314, upon activation, may further enable an operatorto input various parameters relating to deployment of a moving platform,such as an identifier of the moving platform to be deployed and an areato which the moving platform is to be deployed.

The interface element 312 is configured to, upon activation, cause adeployed moving platform to return from the area to which the movingplatform was deployed. That is, activation of the interface element 312causes the deployed moving platform to be “called back.” The movingplatform may be directed to return to a deployment station, such as torecharge and/or upload any data captured by the moving platform. Theinterface element 312, upon activation, may enable an operator to inputvarious parameters relating to calling back a deployed moving platform,such as an identifier of the moving platform and a deployment station towhich the moving platform is to return.

The interface element 318 is configured to, upon activation, requestdata from a deployed moving platform. For example, the interface element318, upon activation, causes one or more deployed moving platforms totransmit data to a receiving system, such as the central system. Forexample, a wireless signal may be sent to a deployed moving platformindicating that the moving platform is to transmit (e.g., wirelessly)data to the central station. Examples of such data may include datacaptured by the moving platform (e.g., images, RF data, or soundsamples), the position of the moving platform and correspondingtimestamp, or environmental conditions at the area (e.g., wind speed,precipitation, or light level). The interface element 318, uponactivation, may enable an operator to input various parameters relatingto requesting data from a deployed moving platform, such as the movingplatform identifier and the requested data or type of data.

The interface element 316 is configured to, upon activation, causetransmission of data to one or more deployed moving platforms. The datamay be transmitted from the central station to the deployed movingplatform, for example. The transmission may be wireless. The transmitteddata may comprise data that the central station received from othermoving platforms (and subsequently stored), such as the other movingplatform's position, data captured by the other moving platform, or thestatus of various aspects of the other moving platform (e.g., sensorprofile, power profile, communication profile, or flight profile). Theinterlace element 316, upon activation, may enable an operator to inputvarious parameters relating to transmitting data to one or more deployedmoving platform, such as the identifier of the deployed moving platformto which data is to be sent and the data or type of data to send to thedeployed moving platform. The interface element 318 and the interfaceelement 316 may be used in conjunction with one another to effect a dataexchange between two deployed moving platforms. For example, an operatormay activate the interface element 318 to request data from a deployedmoving platform. The central station may subsequently receive therequested data. The operator may activate the interface element 316 tocause that received data to be transmitted to another deployed movingplatform.

The interface element 324 is configured to, upon activation, causeimages or video captured by a deployed moving platform to be shown inthe display area 310. The images or video may be live images or video orrecorded, past images or video. The interface element 324, uponactivation, may enable an operator to input various parameters relatingto the display of captured images or video in the display area 310, suchas an identifier of die moving platform whose captured images or videois to be shown in the display area 310 and the particular sensor or typeor sensor that the moving platform is to use to capture said images orvideo. For example, an operator may indicate whether the display area310 is to show thermal images from a thermal camera of a moving platformor the conventional images from a visible light camera of the movingplatform.

The mission status area 330 is configured to display updates to one ormore ongoing missions. The mission updates within the mission statusarea 330 are shown in FIG. 3 as scrolling text updates, but theapplication is not so limited. As examples, the mission status area 330may indicate that: a mission has been initiated (and various parametersof the mission), a moving platform has been deployed for die mission, anintermediate step of the mission has been accomplished (e.g., locating atarget but not yet determining an identity), the first moving platformis unable to perform the mission, a second moving platform has beendeployed to replace/supplement the first moving platform, and themission has been accomplished. Activation of any of the interfaceelements 312-324 may be also indicated in the mission status area 330.

FIG. 4 illustrates a method 400 for determining an object associatedwith a target and/or an activity associated with the target using one ormore moving platforms, such as the moving platform(s) 18 of FIGS. 1A and2. For example, the method 400 may be implemented to surveil a targetperson (e.g., a person of interest) using one or more moving platformsand determine those individuals with whom the target person associatesand/or determine the activities that the target person engages in. Themethod may be further implemented to determine a pattern of life of thetarget person. The target person may be typically a person whoseidentity is known. For example, a target person may be a criminalsuspect, a person wanted by the police (e.g., a person with a warrantfor his or her arrest), or a spouse subject to (or expected to besubject to) a divorce proceeding. A second moving platform may bedeployed to replace or assist an initially deployed first movingplatform, such as if the first moving platform is unable to adequatelyperform its designated task.

At step 410, an instruction is received to determine, using one or moremoving platforms, at least one or more of an object associated with atarget or an activity associated with the target. The target may be atarget person. The instruction may be received via a central system,such as the central system 14 of FIG. 1A. For example, an operator mayenter the instruction into the central system via a graphical userinterface, such as the GUI 300 of FIG. 3. The operator may activate theinterface element 320 of the GUI 300 to enter the instruction. Theinstruction may be provided by a law enforcement agency to track atarget person and determine objects and/or activities associated withthe target person. A law enforcement agency may provide the instructionin order to gather evidence for a criminal investigation of the targetperson, as well as to possibly determine other persons that may beinvolved in a same criminal endeavor as the target person.

An object associated with the target person may comprise a person thatinteracts with the target person and/or a person located proximate thetarget person. For example, a person associated with the target personmay comprise a person with whom the target person converses, embraces,shakes hands (or otherwise makes physical contact), or performs abusiness transaction (legal or illicit). A person associated with thetarget person may be a person proximate the target person. Suchproximity may be measured by a premises or property boundary in whichthe target person is located. Such proximity may be additionally oralternatively measured according to a prescribed distance from thetarget person. For example, a person may be considered proximate thetarget person if the person is within 20 feet of the target person.

Additionally or alternatively, an object associated with the targetperson may comprise an inanimate object. For example, an object maycomprise a vehicle, such as a vehicle operated by the target person. Anobject may comprise a license plate of a vehicle. As another example, anobject may comprise a weapon, such as a firearm. As yet another example,an object may comprise a package or container of an illegal substance,such as an illegal drug.

An activity associated with the target person may comprise a businesstransaction (e.g., a drug deal) or a physical activity with anotherperson (e.g., a romantic physical encounter), as examples. An activityassociated with the target person may comprise a pattern of life of thetarget person. A pattern of life of the target person may reflectmultiple activities engaged in by the target at various times. Forexample, a pattern of life may indicate a typical travel route (e.g., acommute route to work or school) of the target or one or more locationsthat the target person frequents. A pattern of life may indicate varioustiming aspects of the target person's activities, such as the typicaltime of day that the target person travels or the typical time of daythat the target person leaves his or her residence. A pattern of lifemay comprise a first activity during a first time period and a secondactivity during a later second time period. The first and secondactivities may be the same or different types of activities. The firstand second activities may occur at the same or different locations.

The instruction may comprise data according to which the target personmay be identified. For example, the instruction may comprise a digitalfacial profile of the target person, such as an image of the targetperson's face or, indeed, a whole-body image of the target person. Asanother example, the instruction may comprise data indicating a cellphone of die target person, such as an RF signature associated with thecell phone.

The instruction may indicate that the one or more moving platformsshould capture the target person from as many angles (horizontal,vertical, or a combination thereof) as possible (e.g., at least aminimum number of angles). An angle may be defined according to apre-determined number of degrees, such as 15 degrees, 30 degrees, or 45degrees. An angle may be with respect to the target person, object, oractivity.

At step 420, a first moving platform is moved (e.g., caused to be moved)to a first area associated with the target (e.g., target person). As anexample, the first moving platform may be moved to the first area inresponse to an input to a graphical user interface associated with thecentral system, such as activation of the interface element 314 of theGUI 300. The first moving platform is configured with at least a firsttype of sensor. The first moving platform may be initially moved from adeployment zone, i.e., a second area. For example, the second area maybe deployed from the deployment station 22 of FIG. 1A. The first movingplatform may be moved to the first area associated with the targetperson based on the instruction to determine an object and/or activityassociated with the target person. At least a portion of the instructionmay be provided to (e.g., uploaded to) the first moving platform via theintermediate or central system, including via the deployment station.The instruction may indicate the first area.

The first area associated with the target person may be an area at whichthe target person is located or is expected to be located, such as thetarget person's residence. The first area may be defined based on ageographical point of reference, such as an address, premises, orproperty boundary. The first area may be defined as the area within apre-determined distance from such a point of reference, such as the areawithin 50 or 100 feet, for example, of the target person's residence.The first area may be defined by one or more geographical coordinates,such as global positioning system (GPS) coordinates. For example, a GPScoordinate may define the above-referenced single geographical point ofreference or several GPS coordinates may define the bounds of the firstarea.

As indicated above, the first moving platform is configured with atleast a first type of sensor. The first moving platform may beadditionally or alternatively configured with several types of sensors,which may be referred to as a sensor profile of the first movingplatform. The first type of sensor may comprise any of the types ofsensors described in relation to the one or more sensors 42 of FIG. 1B.For example, the first type of sensor may comprise a visible-lightcamera, an infrared camera, a night vision camera, a thermal imagingcamera, an RF sensor, or a microphone.

The first moving platform may be also configured according to a powersupply configuration (a power profile), such as a maximum batterycapacity, a remaining battery power level, a maximum flight time (e.g.,based on the maximum battery capacity), or a remaining flight time(e.g., based on the remaining battery power level). A power profile mayalso relate to a moving platform's capabilities to execute in-flightpower transfer with another moving platform. The first moving platformmay be also configured according to various flight capabilities (aflight profile) with respect to, for example, flight distance, flighttime, maximum or minimum flight altitude, flight speed, night (lowlight) flight capability, and design (e.g., fixed wing or rotary). Thefirst moving platform may be also configured according to communicationcapabilities (a communication profile), such as with respect tocommunication medium (e.g., cellular, satellite, or wirelesscommunication in general) or wireless communication range. Communicationcapabilities may also include the capability of the first movingplatform to function as a wireless base station to effectuatecommunication between a target person (e.g., the target person's mobiledevice) and a cellular network, specifically a stationary wireless basestation connected to said cellular network.

At step 430, the target (e.g., target person) is located, via the firstmoving platform, at the first area. The target may be located via thefirst type of sensor and/or other types of sensors of the first movingplatform. Locating the target person may be performed using a facialrecognition algorithm on an image of the target person. For example,locating the target person may comprise capturing an image of a personat the first area and identifying the person in the image as the targetperson. This may comprise capturing images of numerous persons at thefirst area and subjecting each image to a facial recognition algorithmuntil the target person is identified in an image.

Locating the target person at the first area may be performed at leastin part by the first moving platform, such as by a processor onboard thefirst moving platform. For example, the processor onboard the firstmoving platform may perform image recognition to identify the targetperson at the first area. Additionally or alternatively, locating thetarget person at the first area may be performed, at least in part, byanother computing device or system, such as the intermediate or centralsystem. In this case, the first moving platform may transmit one or moreimages captured by the first moving platform to the intermediate orcentral system. The intermediate or central system may subject the oneor more images to a facial recognition algorithm to identify the targetperson at the first area. The intermediate or central system maytransmit data identifying the target person in the images back to thefirst moving platform. The precise location (e.g., geographicallongitude and latitude coordinates) of the target person and/or thetime(s) that the images of the target person were captured may berecorded, such as for reference when deploying another moving platform.Further data regarding the target person recognized in the images may bealso recorded and/or transmitted back to the first moving platform, suchas the size, shape, and color of the target person.

In some embodiments, if the first moving platform proves insufficient tolocate the target person at the first area, a replacement orsupplemental moving platform may be deployed to the first area. Thisother moving platform may be equipped with a different sensor profilethan that of the first moving platform. For example, the images capturedby the first moving platform may be inadequate to identify the targetperson in the images. The other moving platform may be configured with amore powerful camera, a camera with a higher resolution, and/or a cameramore suitable for present conditions to capture one or more images ofthe suspected target person. Additionally or alternatively, this othermoving platform may be configured with a different, more suitable powersupply profile, flight profile, and/or communication profile than thatof the first moving platform. A machine learning algorithm may be usedto locate the target person at the first area.

Once the target person is located, the first moving platform may trackthe target person. For example, it may be necessary that the firstmoving platform track the movements of die target person. This mayentail moving to another area as the target person moves outside of theoriginal first area. If the first moving platform is unable toadequately track the target person, another moving platform may bedeployed to assist or replace the first moving platform. Geographicallocations (e.g., GPS coordinates) of the moving first moving platformand the moving target person may be intermittently transmitted to theintermediate or central system, such as to enable another movingplatform to take over tracking the target person for the first movingplatform.

At step 440, an attempt is made to determine, via the first movingplatform and its first type of sensor, the at least one of an objectassociated with the target (e.g., target person) or an activityassociated with the target. For example, the attempt to determine theobject and/or activity associated with the target person may beperformed, at least in part, by the first moving platform. Additionallyor alternatively, the attempt may be performed, at least in part, by theintermediate or central system.

Attempting to determine the object and/or activity associated with thetarget person may comprise capturing (or attempting to capture) one ormore images of a suspected object and/or activity associated with thetarget person using the first type of sensor (e.g., a first type ofcamera or other imaging sensor), the one or more images may be fromdifferent angles, such as the result of the first moving platformcircling the suspect object and/or activity. The one or more images maybe organized as still images or may form a video sequence. As notedabove, an object associated with the target person may be another personor an inanimate object. After capturing one or more images of thesuspect object or activity, object recognition (e.g., facialrecognition) may be performed on the one or more images to attempt todetermine the object and/or activity associated with the target person.The object recognition may be performed according to a machine learningalgorithm.

Performing object recognition may comprise comparing any recognizedobjects from the one or more images with objects with known identities.For example, a face recognized in the one or more images may be comparedagainst a database of faces of known individuals to determine theidentity of a person recognized in the one or more images. A similarprocess may be performed with respect to an inanimate object. Forexample, a license plate number of a suspect vehicle may be recognizedin the one or more images. Hie license plate number may becross-referenced with a database of known license plates and theirrespective registered individuals) to attempt to determine the objectand/or activity associated with the target person. Object recognitionmay be also performed to identify any activity associated with thetarget person. For example, an image of the target person reaching outand exchanging an item (e.g., a package of drugs or other illegal item)with another person may be recognized in the one or more images.

Attempting to determine the object and/or activity associated with thetarget person may comprise analyzing sound data captured by a microphoneof the first moving platform. The sound data may comprise a soundrecording of a suspect object, such as a sound recording of a suspectperson's speech. The sound data may comprise an acoustic signatureassociated with the suspect object and/or activity, as another example.In an attempt to determine the object and/or activity associated withthe target person, the sound recording or acoustic signature may becompared to a database of sound recordings or acoustic signaturesassociated with known persons or other objects.

The object recognition may be performed by the first moving platform orthe first moving platform may transmit the one or more images back tothe intermediate or central system for object recognition to beperformed there. An operator may indicate that the one or more images(and/or other data) be sent back to the central station via a GUI. Forexample, an operator may activate the interface element 318 of the GUI300 to cause the first moving platform to send the captured images andother data back to the central station. The object recognition resultsfrom the intermediate or central system may be transmitted back to thefirst moving platform. An operator may indicate that the objectrecognition results be sent to the first moving platform via a GUI. Forexample, an operator may activate the interface element 316 of the GUI300 to cause the central station to send the object recognition resultsto the first moving platform. Conversely, object recognition resultsfrom the first moving platform may be transmitted back to theintermediate or central system. Sound analysis may be similarlyperformed by the first moving platform and/or the intermediate orcentral system (or combination thereof).

Attempting to determine the object or activity associated with thetarget person may comprise an iterative process of subsequent attempts.For example, multiple images and/or multiple objects represented inimages may be subject to object recognition. If a first image or objectwithin an image is unable to be determined as an object or activityassociated with the target person, further images and/or objects withinimages may be subsequently subject to object recognition to attempt todetermine the object or activity associated with the target person. Themultiple images may comprise images captured from multiple angles.

At step 450, a second moving platform is moved (e.g., cause to be moved)to the first area based on the attempting, via the first moving platformand its first type of sensor, to determine the object or activityassociated with the target person. As an example, the second movingplatform may be moved to the first area in response to an input to agraphical user interlace associated with the central system, such asactivation of the interface element 314 of the GUI 300. The secondmoving platform is configured with a second type of sensor that isdifferent from the first type of sensor used by the first movingplatform to attempt to determine the object or activity associated withthe target person. The second moving platform may have a differentsensor profile than the first moving platform. The second movingplatform is generally moved to the first area to replace or assist thefirst moving platform in determining the object or activity associatedwith the target person. A determination to move the second movingplatform to the first area may be performed using a machine learningalgorithm. A determination to move the first moving platform away fromthe first area (e.g., back to a deployment station) may be alsoperformed using a machine learning algorithm.

The second moving platform may be moved to the first area based on afailure to determine the object or activity associated with the targetperson via the first moving platform. The second moving platform may bemoved to the first area based on an inadequacy, although not failure perse, of the first moving platform to determine or facilitatedetermination of the object or activity associated with the targetperson. For example, the object or activity may be determined but at anunacceptable confidence level (e.g., below a confidence threshold). Thesecond moving platform may be moved to the first area to supplementalthe capabilities of the first moving platform even if the first movingplatform is sufficiently able to determine or facilitate determinationof the object or activity associated with the target person. Moving thesecond moving platform to the first area may be initiated by the firstmoving platform and/or the intermediate or central system. For example,the first moving platform and/or the intermediate or central system maydetermine that attempts to determine the object or activity have failedand thus cause the second moving platform to move to the first area. Anoperator may activate an interlace element of a graphical user interfaceto determine the status of the first moving platform's attempts. Forexample, an operator may activate the interface element 318 of the GUI300 to request data from the first moving platform indicating the statusof the first moving platform's attempts.

The first moving platform may be unable or inadequate to determine orfacilitate determination of the object or activity associated with thetarget person due to tike sensor profile of the first moving platform.For example, the first sensor type of the first moving platform may beunable or inadequate to determine or facilitate determination of theobject or activity. As an example, the first type of sensor may be awide-angle camera unsuitable for capturing close-up images of a suspectobject or activity and such close-up images are needed or useful todetermine the object or activity associated with the target person. Thesecond type of sensor of the second moving platform may be a camerahaving a telephoto lens well suited to taking clear close-up images. Asanother example, the first moving platform maybe configured for nightoperation and has only a night-vision camera, a thermal imaging camera,and a low-resolution visible light camera. Consequently, the firstmoving platform may be unable to capture daytime images with sufficientquality to determine the object or activity. Thus, the second type ofsensor of the second moving platform may comprise a high-resolutionvisible light camera configured for daytime operations.

Attempts to determine the object or activity associated with the targetperson may be hindered or prevented by environmental factors, such aswind speed, precipitation, or light level. The second moving platformmay be deployed to compensate for one or more of said environmentalfactors. For example, if the first moving platform is configured withonly a visible light camera, the onset of twilight or nighttime mayinhibit attempts to determine the object or activity associated with thetarget person. Thus, the second type of sensor may comprise anight-vision camera or an infrared thermal imaging camera. As anotherexample, due to high wind speeds at the first area that interfere withthe first moving platform's flight performance, the second movingplatform may be configured with a fixed wing design that is lessaffected by high wind speeds.

Attempts to determine the object or activity associated with the targetperson may be additionally or alternatively hindered or prevented by thepower profile, flight profile, and/or communication profile of the firstmoving platform. For example, the first moving platform may haveinsufficient battery power to continue to monitor the first area. Thus,the second moving platform may be deployed having a folly chargedbattery. As another example, the first moving platform may be configuredwith a fixed wing design and is unable to capture a sustained, singleperspective video of the target person and associated objects and/oractivities. Thus, the second moving platform may be configured with arotary design suitable for capturing video from a single perspective. Asyet another example, the first moving platform at the first area may beunable to communicate with a wireless base station to transmit capturedimages and other data back to the intermediate or central system. Thus,the second moving platform may be configured with a more powerfultransceiver that is able to communicate with the wireless base station.

In some instances, the target person or object or activity associatedwith the target person may move to a second area. As such, it may berequired that the second moving platform track the target person orobject associated with the target person to the second area. In otherinstances, the target person or object associated with the target personmay have already moved to the second area. The first moving platform mayhave tracked the target person or object to the second area, in thiscase, the second moving platform may move to the second area to “meet”the first moving platform and take over or replace the first movingplatform at the second area.

The method is not limited to moving only a second moving platform toreplace or assist the first moving platform. Rather, a third, fourth,etc. moving platform may be deployed in addition to the second movingplatform. Similarly, multiple moving platforms may be already deployedto the first area and engaged in attempting to determine the object oractivity associated with the target person. Additional moving platformsmay be deployed to assist or replace one or more of the multiple movingplatforms already at the first area.

At step 460, the at least one of an object associated with the target(e.g., target person) or an activity associated with the target isdetermined via the second moving platform and the second type of sensor.For example, the object or activity associated with the target personmay be determined using a thermal imaging camera of the second movingplatform that was provided to take over the image capture functionalityof an inadequate visible light camera of the first moving platform. Theimages captured by the thermal image camera may be used to determine theobject or activity.

Determining the object and/or activity associated with target person maybe performed, at least in part, by the second moving platform.Additionally or alternatively, determining the object or activityassociated with the target person may be performed, at least in part, bythe intermediate or central system. The second moving platform may moveback to the intermediate or central system to upload captured data forthe intermediate or central system to determine the object or activity.Additionally or alternatively, the second moving platform may transmitcaptured data via a wireless base station to the intermediate or centralsystem for the intermediate or central system to determine the object oractivity. An operator may use a graphical user interface associated withthe central station to request data (e.g., captured images) from thesecond moving platform. For example, the interface element 318 of theGUI 300 may be activated to request (and subsequently receive) captureddata from the second moving platform.

Determining the object or activity associated with the target person viathe second moving platform using the second type of sensor may beperformed using techniques similar, in at least some aspects, with theattempting to determine die object or activity via the first movingplatform using the first type of sensor of step 440. For example,determining the object or activity via the second moving platform usingthe second type of sensor may be performing using object recognition(e.g., facial recognition or license plate recognition). The objectrecognition may be performed on one or more images captured by thesecond type of sensor (e.g., a still image camera or video camera).

Determining the object or activity may comprise tracking the object oractivity to a second area to which the target person or object oractivity moved. Determining the object or activity may comprise movingthe second moving platform to a different position at the first areathan that of the first moving platform. The position may be with respectto latitude and longitude or altitude. Determining the object oractivity may comprise capturing data using the second type of sensorfrom multiple angles of the object or activity, such as may beaccomplished by circling the object or activity or the target personhim- or herself. Determining the object or activity associated with thetarget person may comprise using a machine learning algorithm.

FIG. 5 illustrates a method 500 for determining an identity of anunidentified target (e.g., a target person or target inanimate object)using one or more moving platforms, such as the moving platform(s) 18 ofFIGS. 1A and 2. For example, the method 500 may be implemented todetermine the identity of an unknown person in the process of orfollowing a criminal activity. The unknown person may be in flight froma crime location, such as a robbed bank, for example. As such, themethod 500 may be initiated by a law enforcement agency to gatherevidence or to assist in apprehending the person. If a first movingplatform initially deployed to determine the identity of the targetproves unable or inadequate to determine the identity, a second movingplatform may be deployed to replace or supplement the first movingplatform. The second moving platform may have a different configurationthat better allows the target person to be identified. One benefitrealized by the method 500 and other techniques described herein is thatrisk to the target, law enforcement, and any bystanders is minimizedsince law enforcement may deploy the moving platforms according to themethod 500 and other described techniques rather than engaging invehicular or on-foot pursuit of the target.

At step 510, an instruction is received to determine, via one or moremoving platforms, an identity of an unidentified target at a first areaassociated with the target. The target may be a target person. In someaspects, die target may be an inanimate object, such as a vehicle. Inother aspects, the target may transition from a person to a vehicle,such as if the person is initially tracked but then enters and drives avehicle. In yet other aspects, the target may be a target cellular phoneor other mobile communication device, such that the target device's RFsignal and/or signature may be tracked. The instruction may be receivedvia an intermediate or central system (e.g., the intermediate system 20or the central system 14 of FIG. 1A). For example, an operator may enterthe instruction into the central system via a graphical user interface,such as the GUI 300 of FIG. 3. The operator may activate the interfaceelement 320 of the GUI 300 to enter the instruction. The instruction mayindicate an area associated with the target person (e.g., the firstarea), such as the location of a crime in progress. The instruction mayindicate that the one or more moving platforms should capture images orother data from as many angles as possible to facilitate facialrecognition. For example, the instruction may indicate a minimum numberof angles.

At step 520, a first moving platform is moved (e.g., caused to be moved)to the first area associated with the target (e.g., the target person)based on the instruction. As an example, the first moving platform maybe moved to the first area in response to an input to a graphical userinterface associated with the central system, such as activation of theinterface element 314 of the GUI 300. The first moving platform isconfigured with at least a first type of sensor. The first movingplatform may receive the instruction via a deployment station, such asthe deployment station 22 of FIG. 1A. Additionally or alternatively, thefirst moving platform may receive the instruction wirelessly. The firstmoving platform may be initially moved from the deployment station. Thefirst area may be defined by an address or property boundary.Additionally or alternatively, the first area may be defined accordingto a pre-determined distance from a geographic point of reference, suchas an address or set of geographical coordinates.

As indicated above, the first moving platform is configured with atleast a first type of sensor, which may define, at least in part, asensor profile of the first moving platform. The first sensor type maycomprise a visible light (daytime) camera, a night-vision camera, aninfrared camera, a thermal imaging camera, a microphone, or an RFsensor. The first moving platform may be configured according to a power(e.g., battery) profile, a communication profile, and a flight profile.

In some aspects, additional moving platforms may be moved to the firstarea along with the first moving platform. Each of these movingplatforms may be configured with the same or similar profiles (e.g.,with respect to sensor, flight, communication, or power profiles). Insome cases, at least some of the moving platforms may be configuredaccording to different profiles than at least some other of the movingplatforms. For example, one moving platform may be equipped with avisible light camera while another moving platform may be equipped witha thermal camera. The multiple moving platforms may be moved todifferent positions at the first area to capture multiple angles of thetarget. For example, the first moving platform may be moved to a firstposition, another moving platform may be moved to a second position, andyet another moving platform may be moved to a third position. If thetarget is moving, one moving platform may be positioning ahead of thetarget's movement, another to the left of the target, another to theright of the target, and another behind the target's movement. Yetanother may circle the target as it moves.

At step 530, it is attempted to determine the identity of the target(e.g., the target person or inanimate object) via the first movingplatform. Attempting to determine the identity of the target isperformed via the first type of sensor of the first moving platform. Forexample, the first type of sensor may comprise a thermal imaging camera.Attempts to determine the identity of die target may use (or attempt touse) thermal images captured by said camera. The precise location (e.g.,geographical longitude and latitude coordinates) of the target and/orthe time(s) at which the images of the target or other associated datawere captured may be recorded, such as for reference when deployinganother moving platform. A machine learning algorithm may be used toattempt to determine the identity of the target.

Attempting to determine the identity of the target may be performedusing object recognition, such as facial recognition or license platerecognition, on images captured by the first moving platform. Attemptingto determine the identity of the target may be performed by the firstmoving platform or the intermediate or central system. For example, thefirst moving platform may transmit captured images or other data to theintermediate or central system and the intermediate or central systemmay attempt to determine the identity of the target. As another example,sound recordings captured by the first type of sensor of the firstmoving platform may be transmitted back to the intermediate or centralsystem for speech recognition or acoustic signature analysis. As anotherexample, RF signals and/or signatures (e.g., an RF profile) captured bythe first moving platform may be transmitted back to the intermediate orcentral system for RF analysis. An operator may indicate that the one ormore images, sound recordings, or other data be sent back to the centralstation via a GUI. For example, an operator may activate the interfaceelement 318 of the GUI 300 to cause the first moving platform to sendthe captured images, sound recordings, or other data back to the centralstation.

In an aspect in which multiple moving platforms are initially deployedto the first area, some or all of the moving platforms may attempt todetermine the identity of the target. Additionally or alternatively, themoving platforms may exchange captured data with one another, such asvia wireless communication. One or more of the moving platforms mayattempt to determine the identity of the target based on data (e.g.,captured data, including an RF profile) received from another movingplatform. At least one of the moving platforms may communicate theexchanged data to the intermediate or central system for processing atthe intermediate or central system.

Attempting to determine the identity of the target may comprise aniterative process of subsequent attempts. For example, multiple imagesand/or multiple objects represented in images may be subject to objectrecognition. If a first image or object within an image is insufficientto determine the identity of the target, further images and/or objectswithin images may be subsequently subject to object recognition toattempt to determine the identity of the target. The multiple images maycomprise images captured from multiple angles and/or from differentpositions within the first area.

At step 540, a second moving platform is moved to the first area toreplace or supplement the first moving platform or other movingplatforms at the first area. As an example, the second moving platformmay be moved to the first area in response to an input to a graphicaluser interface associated with the central system, such as activation ofthe interface element 314 of the GUI 300. In some instances, the firstmoving platform may be called back from its deployment to the firstarea. For example, an operator may activate the interface element 312 ofthe GUI 300 to cause the first moving platform to move back to adeployment station associated with the intermediate or central system.

The second moving platform is configured with a second type of sensorthat is different from the first type of sensor. Moving the secondmoving platform to the first area is based on the attempting todetermining the identity of the target (e.g., target person or object)via the first moving platform and first type of sensor. For example,moving the second moving platform to the first area may be based onfailing to determine the identity of the target via the first movingplatform and first type of sensor. As another example, moving the secondmoving platform to the first area may be based on determining theidentity of the target at an unacceptable level of confidence (e.g.,below a confidence threshold). As another example, moving the secondmoving platform to the first area may be based on successfullydetermining the identity of the target, but it is further determinedthat additional data should be captured using the second moving platformto supplement the data captured by the first moving platform.

As noted above, the second type of sensor of the second moving platformis different from the first type of sensor of the first moving platform.For example, the second type of sensor may comprise a telephoto camerafor taking close-up images while the first type of sensor may comprise astandard visible light camera. The second type of sensor may define, atleast in part, a sensor profile of the second moving platform. Thesensor profile of the second moving platform may be different from thesensor profile of the first moving platform.

Additionally, the second moving platform may be configured according toa power profile, a flight profile, and a communication profile. One ormore of the power profile, flight profile, or communication profile ofthe second moving platform may differ in at least some aspect with thepower profile, flight profile, or communication profile of the firstmoving platform, respectively. For example, the second moving platformmay have full battery power while the first moving platform may have lowbattery power. As another example, the second moving platform may beconfigured as a fixed wing design while the first moving platform may beconfigured as a rotary design. As yet another example, the second movingplatform may be configured for cellular wireless communication while thefirst moving platform may be configured for satellite wirelesscommunication. Related to the above types of profiles, moving the secondmoving platform to the second area may be based on one or moreenvironmental conditions at the first area, such as wind speed,precipitation, or light level.

The determination to move the second moving platform to the first areamay be performed by the first moving platform and such determination maybe communicated back to the intermediate or central system. Thedetermination to move the second moving platform to the first area maybe performed based on data exchanged between the first moving platformand other moving platforms at the first area. Additionally oralternatively, such a determination may be performed by the intermediateor central system. The determination to move the second moving platformmay be performed using a machine learning algorithm. A determination tomove the first moving platform away from the first area (e.g., back to adeployment station) may be also performed using a machine learningalgorithm.

At step 550, the identity of the target is determined via the secondmoving platform and second type of sensor. The identity of the targetmay be based on images or other data captured by the second movingplatform using the second type of sensor. Techniques used to determinethe identity of the target may be the same or similar as those used toattempt to determine the identity of the target via the first movingplatform and first type of sensor. Such techniques may includesubjecting captured images to object (e.g., facial) recognition, forexample. Determining the identity of the target may be facilitatedfurther by the power profile, flight profile, and/or communicationprofile of the second moving platform.

Determining the identity of the target may be performed by the secondmoving platform, the intermediate or central system, or a combinationthereof. For example, an operator may activate the interface element 318to request that the second moving platform transmit data (e.g., capturedimages) to the central system. The central system may analyze therequested data to determine the identity of the target. In an aspect inwhich multiple moving platforms are deployed along with the secondmoving platform, the multiple moving platforms and second movingplatforms may exchange captured data between each other. The identity ofthe target may be determined based on the exchanged data. The exchangeddata may be subjected to a machine learning algorithm to determine theidentity of the target.

FIG. 6 illustrates a method 600 for locating a target at a first areausing one or more moving platforms, such as the moving platform(s) 18 ofFIGS. 1A and 2. The target may be a person or an inanimate objectExample inanimate objects include a road vehicle, a plane, a boat or ananimal (e.g., a pet). The subject target of the method 600 is generallycontemplated to be a target with a known identity. The method 600 may beinitiated for any of several purposes. For example, the method 600 maybe used to locate stolen property (e.g., a stolen car) or a lost pet.The method 600 may be used in a search and rescue operation to locate alost or missing person. The method 600 may be further used to locate aperson and provide cellular service to that person.

At step 610, an instruction is received to locate, via one or moremoving platforms, a target at a first area associated with the target.An operator may enter the instruction via a graphical user interface,such as the GUI 300 of FIG. 3. The operator may activate the interfaceelement 320 of the GUI 300 to enter the instruction.

As noted, the target may be a target person or an inanimate object. Thetarget may be a lost person or a person needing cellular service. Thetarget may be stolen property, such as a car. The target may be a lostpet or other animal. The first area may be an area at which the targetis located generally (although an exact position within the first areamay not be known) or is expected to be located generally. The first areamay be defined according to an address, property boundary, geographicalcoordinates, or a distance from a geographical point of reference, assome examples. The instruction may be provided via an intermediate orcentral system (e.g., the intermediate system 20 or the central system14 of FIG. 1A). The instruction may be downloaded to a moving platformto effectuate locating the target.

The instruction may indicate one or more identifiers of the target, suchas images of the target or the target's face. Other example identifiersmay include an RF signal, such as a cellular RF signal signature of thetarget's cell phone. Another example identifier may include a cellphone's or cell phone subscriber's identifier, such an internationalmobile subscriber identity (IMSI) number stored on the cell phone'ssubscriber identity module (SIM) card. Yet other example identifiersinclude a license plate number or an acoustic signature associated withthe target.

At step 620, a first moving platform is moved (e.g., caused to be moved)to the first area associated with the target based on the instruction.The first moving platform may be moved to the first area in response toan input to a graphical user interface associated with the centralsystem, such as activation of the interface element 314 of the GUI 300.The first moving platform is configured with a first type of sensor. Thefirst moving platform may receive the instruction via a deploymentstation (e.g., the deployment station 22 of FIG. 1A) and/or wirelessly.The first moving platform may be moved from the deployment station.

As indicated above, the first moving platform is configured with atleast a first type of sensor, which may define, at least in part, asensor profile of the first moving platform. The first sensor type maycomprise, for example, a visible light (daytime) camera, a night-visioncamera, an infrared camera, a thermal imaging camera, a microphone, oran RF sensor. The first moving platform may be configured according to apower (battery) profile, a communication profile, and a flight profile.The first moving platform may be configured according to a capacity toprovide cellular service to areas proximate the first moving platform.The first moving platform may be configured as a mobile cellular basestation to effectuate communication between the target (or targetperson's mobile device) and a stationary wireless base station (e.g.,the wireless base station 16 of FIG. 1A) that is otherwise too far awayfrom the target or inoperable.

In some aspects, additional moving platform may be moved to the firstarea to effectuate the instruction. Each of the multiple movingplatforms may be moved to different positions at the first area, such asto capture images of different portions of the first area or images fromdifferent angles. The multiple moving platforms or a subset thereof maybe configured similarly to one another or configured differently fromone another.

At step 630, it is attempted to locate, via the first moving platformand the first type of sensor, the target at the first area. Attemptingto locate the target may comprise determining a location of the target,such as a location within the first area. The location of the target maybe defined according to a set of geographical coordinates, for example.The location of the target may be defined according to an address orproperty identifier, as other examples.

As an example, attempting to locate the target at the first area maycomprise capturing one or more images of the first area (or portionthereof). The one or more images may be captured from various angles orfrom various distances. Said images from various angles or from variousdistances may be captured by additional moving platforms at the firstarea besides the first moving platform. The one or more images may besubject to object recognition (e.g., facial recognition) to attempt toidentify the target in the one or more images. The object recognitionmay be based on one or more known images of the target, such that anattempt is made to match a recognized object in the analyzed images withthe known image(s) of the target.

As another example, attempting to locate the target may comprisecapturing an RF or cellular signal signature at the first area, lirecaptured RF or cellular signal signature may be analyzed to compare thecaptured signature with a known signature associated with the target. Acellular signal may also indicate a mobile device identifier (e.g., theIMSI number from the cellular device's SIM card) which may be comparedto a known mobile device identifier associated with the target.

Attempting to locate the target at the first area may be performed as aniterative process of subsequent attempts. For example, objectrecognition may be performed on a first set of images of the first area.If this is not successful in recognizing the target in the first set ofimages, a second set of images may be captured and subsequently subjectto object recognition to attempt to recognize the target in the secondset of images.

The attempting to locate the target may be performed, at least in part,by the moving platform. In an aspect in which multiple moving platformsare initially deployed to the first area, the attempting to locate thetarget may be performed by one or more of the multiple moving platformsand using data (e.g., captured data) exchanged between one or more ofthe multiple moving platforms. For example, a moving platform mayperform object recognition or cellular signature analysis on capturedimages or cellular signals, respectively. Additionally or alternatively,the attempting to locate the target may be performed, at least in part,by the intermediate or central system. For example, the moving platformmay transmit captured data to the intermediate or central system forprocessing. The attempting to locate the target at the first area may beperformed using a machine learning algorithm. The moving platform maytransmit captured data in response to an operator activating theinterface element 318 to request said data from die moving platform.

In some instances, the target may move beyond the first area as thefirst moving platform is attempting to locate the target. That is, thetarget may move to a second area. Accordingly, it may be necessary forthe first moving platform to move from the first area to the second areain attempts to locate/track the target.

At step 640, a second moving platform is moved (e.g., caused to bemoved) to the first area, such as to replace or support the first movingplatform in locating the target. The second moving platform may be movedto the first area in response to an input to a graphical user interface,such as activation of the interface element 314 of the GUI 300. Thesecond moving platform is configured with a second type of sensor thatis different from the first type of sensor of the first moving platform.The second moving platform may be configured with a different sensorprofile than the sensor profile of the first moving platform. The secondmoving platform also may be configured differently from the first movingplatform with respect to power, flight, and communication (includingcapabilities as a mobile cellular base station) profiles. Moving thesecond moving platform to the first area may be initiated by the firstmoving platform or the intermediate or central system. A determinationto move the second moving platform to the first area may be performedusing a machine learning algorithm. A determination to move the firstmoving platform away from the first area (e.g., back to a deploymentstation) may be also performed using a machine learning algorithm.

Moving the second moving platform to the first area is based on theattempting to locate the target via the first type of sensor of thefirst moving platform. Moving the second moving platform to the firstarea may be based on the first moving platform being unable to locatethe target. For example, the first type of sensor may be unsuitable to acurrent nighttime search and the second moving platform having anight-vision camera (i.e., the second type of sensor) may be moved tothe first area to more effectively search for the target. Moving thesecond moving platform to the first area may be based on data capturedby the first moving platform using the first type of sensor. Forexample, images captured by the first moving platform may be out offocus or under- or over-exposed. Further, the target may be simply notdepicted in any of die captured images.

Moving the second moving platform to the first area may be further basedon the power, flight, or communication profile of the second movingplatforms, particularly with respect to any differences between thecorresponding profile(s) of the first moving platform. For example, thefirst moving platform may have a low battery level while the secondmoving platform has a high battery level. As another example, the firstmoving platform may be configured for limited altitudes while the secondmoving platform may be configured for the high altitudes necessary oruseful for locating the target. As another example, the first movingplatform may be configured for only terrestrial cellular communication.The first area, however, may be remote from any cellular network. Thus,the second moving platform may be configured for satellite communicationso that the second moving platform can report back positions, captureddata, etc. to the intermediate or central system. Relatedly, moving thesecond moving platform to the first area may be based on one or moreenvironmental factors at the first area, such as wind speed, lightlevel, or precipitation.

Moving the second moving platform may be based on estimating thelocation of the target, but only at an unacceptable confidence level(e.g., below a confidence threshold). Thus, the second moving platformmay be moved to the first area to preferably estimate or determine thetarget at a higher, acceptable confidence level (e.g., satisfying aconfidence threshold). Moving the second moving platform to the firstarea may be based on the first moving platform locating the target. Yet,for example, further data relating to the target and/or first area isdesired but the first moving platform is unable to capture or determinesuch further data.

At step 650, the target is located via the second moving platform andthe second type of sensor. For example, the second moving platform maydetermine the location of the target using the second type of sensor. Asanother example, the intermediate or central system may determine thelocation of the target based on data captured by the second movingplatform and transmitted back to the intermediate or central system. Thedata captured by the second moving platform may be transmitted back tothe intermediate or central system in response to an input to agraphical user interface, such as activation of the interface element318 of the GUI 300. The target may be located at the first area. In someaspects, the target may be located at a second area, such as if thetarget was a moving target (e.g., a moving vehicle or roving animal).Locating the target may comprise the second moving platform tracking thetarget as the target moves.

Locating the target via the second type of sensor of the second movingplatform may be performed according to one or more of the techniquesthat were implemented or may have been implemented in attempting tolocate the target at step 630. For example, the second moving platformmay capture one or more images at the first area. The captured imagesmay be subject to object recognition (e.g., facial recognition orlicense plate recognition) to recognize the target in the one or moreimages.

The image timestamp for images (or other data) that do depict the targetmay be associated with the location of the target. For example, theintermediate or central system may record, as a pair, a determinedlocation of the target and the time that the target was identified atthe location. Movement of the target may be indicated by a sequences oflocation/time pairs.

The second moving platform may be provided with data to facilitatelocating the target. Such data may have been determined in attempting tolocate the target via the first type of sensor of the first movingplatform, such as an indication of those portions of the first area inwhich the first moving platform already captured images or other data orotherwise covered. The second moving platform may be provided thelocation of the first moving platform at the first area, for example.The second moving platform may be provided data already captured by thefirst moving platform, such as images already captured by die firstmoving platform. Such data provided to the second moving platform may beprovided by die intermediate or central system, such as via a wiredconnection before the second moving platform is deployed or via awireless connection after the moving platform is deployed. Such dataprovided to the second moving platform may be provided by the firstmoving platform (or other additional moving platforms already at thefirst area) in a wireless data exchange with the second moving platformat the first area.

In some aspects, the target may be located at the first area usingadditional moving platforms that were moved to the first area based onthe attempting to locate the target via the first moving platform andthe first type of sensor. The additional moving platforms may beconfigured with the same or different sensor profile as the secondmoving platform. Ihe additional moving platforms may be moved todifferent positions within the first area than the second movingplatform. For example, the target may be located via a third movingplatform using the second type of sensor. Or the target may be locatedvia a third moving platform using a third, different type of sensor. Thethird moving platform may be moved to the same position within the firstarea as the second moving platform or to a different position within thefirst area as the second moving platform. The third moving platform maycaptures images or other data from a different angle than the secondmoving platform. Additionally or alternatively, the target may belocated via a fourth moving platform using a third type of sensor,different than the first and second types of sensors.

The first, second, third, and fourth moving platforms (or combination orsub-combination thereof) may exchange data to facilitate locating thetarget. The positions of the multiple moving platforms may be used in atriangulation technique to determine the location (e.g., thegeographical coordinates) of the target. Triangulation techniques may bealso used when three or more moving platforms at the first area areconfigured with RF sensors and the target emits an RF signal. The threeor more moving platforms may each detect the RF signal from the targetand exchange data between each other indicating their respectivedetections of the RF signal. Based on this exchanged data, triangulationtechniques may be used to determine the location of the target.

In some aspects, upon locating the target at the first area, the secondmoving platform (and/or additional moving platforms if such is the case)may track any movements of the target. For example, the target may movefrom the first area to a second area. The second moving platform maylikewise move to the second area to track the target. Further locationsof the target may be continuously or intermittently determined duringthe movement of the target to the second area. Additionally oralternatively, upon locating the target, the second moving platform maycircle the target. When circling the target, the second moving platformmay capture further images or other data relating to the target. In someaspects, the second moving platform may need to initially circle thetarget to capture sufficient images or other data to determine thelocation of the target. While tracking or circling the target, the firstor second moving platform may be caused to move or remain within apre-determined distance from the target.

In some aspects, the second moving platform may provide additionalservices to the target. For example, the second moving platform maycarry food, water, clothing, a light source, medical supplies, rope, ablanket, or other provisions. After locating the target, the secondmoving platform may land near the target and the target may retrievesuch provisions from the second moving platform. The second movingplatform may also provide a detectable light or RF “beacon” to thetarget to facilitate determining a subsequent location of the target orto facilitate tracking the target. The second moving platform may alsoprovide a communication device, such as a 2-way radio or cell phone, tothe target.

In some aspects, the method 600 is initiated to not only locate thetarget but also to enable wireless communication for the target. Forexample, the method 600 may be initiated to provide cellular service forthe target or other persons, such as after a disaster has destroyed oneor more nearby stationary cellular base stations. Accordingly, thesecond moving platform (and/or the first moving platform) may beconfigured as a mobile cellular base station. The first moving platformmay not be configured to enable or sufficiently enable cellular servicefor the target and this may be one basis for moving the second movingplatform to the first area to locate the target. The second movingplatform configured with a mobile cellular base station may be moved tothe first area to provide cellular service for the target.

The first and/or second moving platforms may be initially deployed at adisaster area before the instruction is received to locate the target. Adisaster may comprise a fire, a meteor crash, a plane crash, anavalanche, or a lightning strike, as some examples. The first and/orsecond moving platforms may be deployed to the disaster area incontemplation of enabling cellular service for the target person orother persons. The first and/or second moving platforms may be deployedto the disaster area responsive to determining that the disasteroccurred. The first and/or second moving platforms may remain within thedisaster area until receiving the instruction to locate the target andenable cellular service for the target. The disaster area may comprisethe first area. Thus, moving the first and/or second moving platform tothe first area may comprise moving the first and/or second movingplatform from an area within the disaster area (a second area, differentfrom the first area) to the first area.

Upon locating the target, the mobile cellular base station of the secondmoving platform may establish a cellular connection with a mobile deviceof the target. Cellular communication from the target's mobile devicemay be relayed by the second moving platform to another communicationmedium or network to effectuate communication to and from the target'smobile device. Relaying the target's communications may compriseestablishing, by the second moving platform, a connection with anexternal network via which to relay the target's communications. Forexample, the second moving platform may relay the target'scommunications via a satellite link to a satellite network. As anotherexample, the second moving platform may relay the target'scommunications to a cellular network via a stationary cellular basestation that was not destroyed or affected by the disaster. Afterlocating the target and initially providing (or attempting to provide)cellular service to the target, the second moving platform may furthermove within the first area to provide a best possible signal for thetarget. Further, after initially providing cellular service to thetarget, the second moving platform may track and follow the target asthe target moves so as to maintain the cellular service to the target.

Such techniques to provide cellular service to the target are notlimited to a disaster situation but may be also employed, for example,when the target is located remote from any stationary cellular basestations.

In some aspects, upon locating the target, a message may be generatedand sent to an associated party indicating that the target has beenlocated. For example, if the target was a lost or missing person (e.g.,a target of a search and rescue mission), personal contacts of the lostor missing person may be notified that the person was found. Further,emergency or rescue personnel may be notified to assist in rescuing thelost or missing person. For example, a helicopter may be deployed to thetarget's location. If the target was a lost or missing inanimate object(e.g., a stolen car), the owner of such object may be notified that theobject was located and where the object is located. Further, lawenforcement may be notified so that the law enforcement may retrieve atarget object from the determined location or arrest a target person atthe determined location.

While the system and method have been described in terms of what arepresently considered specific embodiments, the disclosure need not belimited to the disclosed embodiments. It is intended to cover variousmodifications and similar arrangements included within the spirit andscope of the claims, the scope of which should be accorded the broadestinterpretation to encompass all such modifications and similarstructures. The present disclosure includes any and all embodiments ofthe following claims.

1. A method comprising: receiving an indication of a target with anunknown identity and an indication of an area associated with thetarget; receiving an instruction to determine the identity of theindicated target; causing to move a first moving platform to the area,wherein the first moving platform is configured with a first type ofsensor; attempting to determine, via the first moving platform and thefirst type of sensor, the identity of the target; causing to move asecond moving platform to the area based on the attempting step, whereinthe second moving platform is configured with a second type of sensordifferent from the first type of sensor of the first moving platform;and determining, via the second moving platform and the second type ofsensor, the identity of the target.
 2. The method of claim 1, wherein:the attempting to determine the identity of the target is based on datacaptured via the first moving platform and the first type of sensorwhile the first moving platform is at a first position in the area, andthe determining the identity of the target is based on data captured viathe second moving platform and the second type of sensor while thesecond moving platform is at a second position, different from the firstposition, in the area.
 3. The method of claim 1, wherein the determiningthe identity of the target is based on a plurality of images capturedvia the second moving platform and the second type of sensor, andwherein at least two images of the plurality of images are captured fromdifferent angles with respect to the target.
 4. The method of claim 1,further comprising: causing the first moving platform to wirelesslytransmit data, associated with the attempting to determine the identityof the target, to the second moving platform, wherein the identity ofthe target is determined based on the data wirelessly transmitted by thefirst moving platform to the second moving platform.
 5. The method ofclaim 1, further comprising: causing to move a third moving platform tothe area, wherein the attempting to determine the identity of the targetis further attempted via the third moving platform.
 6. The method ofclaim 1, further comprising: causing to move a third moving platform tothe area, wherein the identity of the target is further determined viathe third moving platform.
 7. The method of claim 6, wherein the thirdmoving platform is configured with a third type of sensor different fromthe second type of sensor of the second moving platform, and wherein theidentity of the target is determined via the third type of sensor of thethird moving platform.
 8. The method of claim 6, wherein the identity ofthe target is determined based on data captured via the second movingplatform at a first position in the area and data captured via the thirdmoving platform at a second position, different from the first position,in the area.
 9. The method of claim 1, further comprising: responsive tothe target moving to a second area, causing to move the second movingplatform to the second area to remain within a pre-determined distancefrom the target.
 10. The method of claim 1, wherein the target comprisesa target person, the second type of sensor comprises an imaging sensor,and the identity of the target person is determined based on performingfacial recognition on one or more images of the target person capturedby the imaging sensor.
 11. The method of claim 1, wherein the targetcomprises a vehicle, the second type of sensor comprises an imagingsensor, and the identity of the vehicle is determined based onperforming license plate recognition on one or more images of thevehicle captured by the imaging sensor.
 12. The method of claim 1,wherein the identity of the target is determined based on data capturedby the first moving platform.
 13. The method of claim 1, wherein thecausing to move the second moving platform to the area is based on atleast one of a difference between a power profile of the first movingplatform and a power profile of the second moving platform, a differencebetween a flight profile of the first moving platform and a flightprofile of the second moving platform, or and a difference between acommunication profile of the first moving platform and a communicationprofile of the second moving platform.
 14. A system comprising: agraphical user interface (GUI); one or more processors; and memorystoring instructions that, when executed by the one or more processors,effectuate operations comprising: receiving an indication of a targetwith an unknown identity and an indication of an area associated withthe target; receiving an instruction to determine the identity of theindicated target; causing to move, based on a first operator interactionwith the GUI, a first moving platform to the area, wherein the firstmoving platform is configured with a first type of sensor; attempting todetermine, based on data captured by the first moving platform using thefirst type of sensor, the identity of the target; causing to move, basedon the attempting step and a second operator interaction with the GUI, asecond moving platform to the area, wherein the second moving platformis configured with a second type of sensor different from the first typeof sensor of the first moving platform; and determining, based on datacaptured by the second moving platform using the second type of sensor,the identity of the target.
 15. The system of claim 14, wherein theinstruction is input to the system via a third operator interaction withthe GUI.
 16. The system of claim 14, wherein the data captured by thefirst moving platform using the first type of sensor is received by thesystem based on a third operator interaction with the GUI.
 17. Thesystem of claim 14, wherein the operations further comprise:transmitting data, based on a third operator interaction with the GUI,to the second moving platform, wherein the data captured by the secondmoving platform using the second type of sensor is based on the datatransmitted to the second moving platform.
 18. The system of claim 17,wherein the data transmitted to the second moving platform comprises atleast one of the data captured by the first moving platform using thefirst type of sensor, a position of the first moving platform at thearea, a sensor profile of the first moving platform, a power profile ofthe first moving platform, a flight profile of the first movingplatform, and a communication profile of the first moving platform. 19.The system of claim 14, wherein the operations further comprise:outputting, via a display area of the GUI, image data captured by atleast one of the first moving platform and the second moving platform.20. A system comprising: a first moving platform configured with a firsttype of sensor; a second moving platform configured with a second typeof sensor different from the first type of sensor of the first movingplatform; and a computing system configured to: receive an indication ofa target with an unknown identity and an indication of an areaassociated with the target; receive an instruction to determine theidentity of the indicated target; cause to move the first movingplatform to the area; attempt to determine, based on data captured bythe first moving platform using the first type of sensor, the identityof the target; cause to move the second moving platform to the areabased on the attempting step; and determine, based on data captured bythe second moving platform using the second type of sensor, the identityof the target.